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ABSTRACT 


Burst  distribution  was  derived  using  the  generating  function. 
However,  this  method  is  only  practical  for  small  values  of  K.  A  special 
case  for  K  =  2  was  carried  out.  The  result  agrees  with  that  derived 
directly  from  the  gap  distributions.  Numerical  results  for  K  *  2  have 
been  obtained  for  the  VHF  channel. 

Product  codes  were  discussed  and  the  probability  of  error  for 
the  product  code  was  derived  in  terms  of  P^(m,n),  the  probability  that  m 
errors  occurred  in  n  bits  with  each  bit  l  positions  apart  from  the  next 
bit. 
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SECTION  1 


SUMMARY 

Burst  distribution  was  derived  using  the  generating  function. 
However,  this  method  is  only  practical  for  small  values  of  K.  A  special 
case  for  K  =  2  was  carried  out.  The  result  agrees  with  that  derived 
directly  from  the  gap  distributions.  Numerical  results  for  K  =  2  have 
been  obtained  for  the  VHF  channel. 

Product  codes  were  discussed  and  the  probability  of  error  for 
the  product  code  was  derived  in  terms  of  P^Cn^n),  the  probability  that 
m  errors  occurred  in  n  bits  with  each  bit  l  positions  apart  from  the 
next  bit. 
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SECTION  2 
MARKOV  GAP  MODELS 


2.1.  BURST  DISTRIBUTIONS 

In  the  Fourth  Quarterly  Progress  Report  [l]  recursive  expres¬ 
sions  were  derived  for  the  burst  distributions  of  the  gap  Markov  model 
using  the  definition  of  a  burst  as  a  sequence  of  bits  starting  and  ending 
in  an  error  and  separated  from  neighboring  bursts  by  at  least  K  error 
free  bits.  The  resulting  expression  for  the  burst  rate  pb(m)  is 

K-l 

pb(m)  ==  £  f  (m)P(Kji)  ,  m  2  2  (1) 

i=0 


where  P(m|n)  is  the  conditional  gap  distribution  and  where  the  f^(m) 
satisfy  the  recursive  relations 


K-l 

Mm)  -  £  f  (m-i-l)[P(ilj)-P(i+l|j)]  ,  m  s  i+3  (2) 

j=0  3 

f  (i+2)  *  {  £  [P(i|j)  -  P(i+lj j)]  [P( j)-P( j+1)]}  / P (K)  (3) 

j“K 

f^(m)  -  0,  m  <  i+2  (4) 

and  where  P(m)  is  the  unconditional  gap  distribution. 

The  relation  given  above  may  be  implemented  directly  using  the 
gap  distributions  of  the  channel  as  inputs,  and  the  results  may  then  be 
compared  with  the  burst  distributions  obtained  directly  from  the  data  to 
check  the  validity  of  the  model.  This  procedure  was  performed  for  solid 
bursts  (K«l)  for  both  the  VHF  and  the  Tropo  channels  with  excellent 
results  [1],  The  results  for  higher  values  of  the  parameter  K  are  being 
processed.  Alternatively,  the  generating  function  method  may  be  used  to 
solve  the  difference  equation  (2)  with  (3)  and  (4)  as  initial  conditions. 
However,  such  a  solution  is  practical  only  for  low  values  of  K  unless 
the  number  of  states  of  the  model  is  reduced  by  using  P(m|n^<n«ai2) 
instead  of  P(m|n)  for  all  n^n^^*  Let  f^(s)  be  defined  by 

f  (s)  -  S  f  1(m+i+l)zra+i  ,  i-l,2,...,K  (5) 

m«0 

If  (2)  is  substituted  in  (5)  then 
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*  K-l 


fi(z)  =  fi-i(i+1>zl  +  2  £  f  i[m+i+l-(i-l)-l]ztn"<'i[P(i-l  I  j)- 

m=l  j=0  J 


P(i|j)] 


K  ee 


=  fi_1(i+l)z  +  E  Z  F  f.  (m+l)i 
j-1  m-1  J  2~L 


where  we  have  defined 


Fij  -  [P(l-l|j-l)-P(i|j-l)3  .  i,j  -  1,2 . K 

Since  fj_^(uri-l)  =  0  for  (m+1)  <  (j-1+2),  (6)  may  be  reduced  to 

K  06 

fi(2)  “  fi-l(i+1)*i  +  zl  E  2  f.  .(ra+Dz1" 

j=l  2  m=j  2 


-  fi_1(i+l)zi  +  z1 


K.  00 

2  Fi \  E  i (n+j+1)  zn+J  ,  for  n=m-j 
j-1  ij  n=0  j  1 


"  z  {fi-i<i+l>  +  E  (8) 

j=l  J  J 

which  may  also  be  written  compactly  as 

[A  (z)  -  F]  f(z)  «=  a  (9) 

where  A  (z)  is  diagonal  matrix  whose  elements  are  -  I  \ 

2*  *  * • >  k'  9 
z  z 

£  is  a  K  X  K  matrix  who  settlements  are  F  ,  and  the  K-dimensional  vectors 
J(z)  and  j  have  elements  f^z)  and  a^^  respectively, 

ai  "  fi-l(i+1)  "  p(io  {PU-l)-P(t)  -  S  F  [P(j-1)-P(j)]}, 

>1  J 

i  ■  1,  2,  . . . ,  K.  (10) 

Equation  (9)  may  now  be  solved  for  £(z)  and  then  the  f  (m)  may  be  obtained 
by  using  (5)  which  finally  yields  the  burst  rate  p  (mrfor  m  a  2.  If  F  is 
nonsingular  (which  means  that  the  conditional  gap  distributions  are  distinct} 
then  the  numerator  of 
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detjA(z)  -  F| 

is  a  polynomial  in  z  of  degree  If  its  roots  {Pi}  are  also 

assumed  to  be  distinct  then  the  general  form  of  the  burst  rate  is 
given  by 

KOC+1) 

2 

p^(m)  *  E  s  2  (H) 

i»l 

The  impracticality  of  this  form  for  large  values  of  K  is  immediately 
apparent  as  the  number  of  terms  increases  rapidly.  However,  for  larger 
values  of  K  the  conditional  gap  distributions  are  not  available  distinctly, 
and  therefore  the  elements  of  F  are  no  longer  distinct..  In  that  case  the 
degree  of  the  polynomial  in  z  is  reduced,  and  consequently  the  general 
form  (11)  has  a  smaller  number  of  terms.  The  case  where  K  =  1  has  already 
been  considered.  The  case  where  K  =  2  will  be  discussed  next  both  exactly 
and  approximately  using  a  reduced  number  of  states. 


2.2.  SPECIAL  CASE,  K  -  2 

The  solution  (9)  for  K  ■  2  may  be  easily  shown  to  result  in  the 
following  expressions 


ft(*) 


i  Ai(z) 
'  A(z) 


i  «  1,2 


where 

A(z)  «  1  -  zFu  -  z2F22  +  z3 
2 

A^(z)  *  z  [a0F j.2  ■  ^1^22 

42(z)  =  a2  +  ,0^  -  a2Fu] 

ai  ■  £i-i(i+l)  ■  fk  [p(l*l) 

where 


^F11F22  “  F12F21^ 

3 


-  Fa  p ( 0)  -  f12p(1)3, 


i 


1,2 


(12) 

(13) 

(14) 

(15) 

(16) 


p(i)  -  [P(i)  -  P(i+1)] 

are  the  unconditional  gap  probabilities.  If  A(z)  is  factored  as  follows 

3 

A(z)  -  n  (1-M)  (17) 

J-l  J 


then  the  expressions  for  f^(m)  may  be  obtained  from  (12)  and  (5),  and  are 
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given  by  the  expressions 


f ,  (m+i+2)  =  S  A.  .P  m+1 

1  j-1  J 


,  i  =  0,1,  m  S  0 


(18) 


where 


Air  • 


WiT1* 


wgi  > _ 

iHe;1)  Fu+2fl  -  3?j'2(FuF22-F12F21) 


(19) 


where  A'(p.-1)  -  ~  M«)|a^  “1  • 

Therefore,  the  general  expression  for  the  burst  rate  is  given  by 


pb(2)  -  f0(2)P(2|0) 


(20) 


Pb(n0 


3 

2 

j“l 


.  £oio)  ,  ,  mil) 

"Oj  8.  +  Alj  2 

u  J  6J  _ 


m 


m  2>  3 


(21) 


In  order  to  simplify  these  expressions  and  reduce  the  number 
of  states,  the  conditional  distributions  P(i  0)  and  P(ijl)  will  be  assumed 
to  be  identical,  and  will  be  replaced  by  P(i  0  <  n  <  1) ,  i.e.  P(i|0)  and 
P( i | 1)  are  approximated  by 


p(  1 1 o, i>  ■ 


(22) 


In  this  case  the  elements  of  F  become 

V12  "  F11  “  1  ■  P<1 |0,1> 

F21  "  F22  ’  p<ll°»1)  ’ 

Similarly  the  a^  becomes 

ai  “  f0(2)  "  H2)  {p(0)  •  Fu  i>p<2>3} 

a2  “  fl(3)  "  ?(2)  *P<1>  '  F22  Cl-P<2>33 

The  expression  for  A(z)  reduces  to 


(23) 


(24) 
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A(z)  =  1-zF 


(25) 


ii " z  f22  =  a-p1z)a-p2z) 


with 


Pl,2  “  ^Fll  -  (F11  +  4F22)^ 


(26) 


Finally,  the  f^z)  may  be  combined  since  P(2  0)  and  P(2  1)  in  (21)  are 


replaced  by  P(2  0,1),  so  that 


~  ~  zai  +  z  i.  a  +  z  a. 

£i(2>  +  £2(2>  ■  mT  *  8  —  7) 


(27) 


From  (1)  and  (5)  the  expression  for  p^(m)  may  be  derived  as  follows 


f 1 (z)  +  f  (z)  =  Z  E  [f  (m+2)z“  +  f  (m+2)zra  ] 
1  m=0  °  1 


mlM)  \  s'“pb(nri'2) 

’  m=C 


(28) 


which  with  (27)  and  (25)  yields 


Pb(m+2) 


PlVa2  .«  _ 

(01-M  pi  ”  (P^fy 


P2ai+a2 


m 


1  H2 

mlu,) 

(Pi  -  e2 


P  (  2  1 0 , 1 ) 


r  , 0  m+1  m+1.  .  m  m  , 

^  a2^i  "  ^2  m  ^  ® 


(29) 


The  expression  (29)  for  ra  «  0  agrees  with  the  expression  given  in  (20) 
if  P( 2  j  0)  is  replaced  by  P( 2 1 0, 1) .  It  is  seen  though  that  the  number 
of  the  exponential  terras  in  (_9)  has  been  reduced  from  three  in  (21)  to 
two. 


2.3.  NUMERICAL  RESULTS  FOR  THE  VHF  CHANNEL 

Numerical  results  for  K  »  2  have  been  obtained  for  the  VHF 
channel.  In  this  case  the  gap  data  yielded  the  following  distributions, 


P(1 

P(2 

P(0) 


0) 

0) 


»  0.6062 
*  0.4063 
0.3868 


P(1 
P  ( 2 
Pd 


1) 

1) 


=  0.5944 
-  0.3884 
0.1293 


Consequently 


the  approximate  values  of  F^  and  F22  are 
Fu  «  0.3977  F22  =  0.2119 
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so  that  the  exponents  j3^  are  given  by 

*  0.7003 
P2  »  -0.3026 

Which  when  substituted  in  (29)  yields  the  following  expression 

Pb(m)  =  (0.07618) (0. 7003) m" 2  -  (0. 01016) (-0. 3026)“" 2  ,  m  £  2. 

The  expression  for  m  =  1  is  obtained  separately  as  shown  in  (1)  and 
should  be  in  exact  agreement  with  the  data,  as  it  does  not  involve 
the  assumptions  of  the  model.  The  result  is 

pbu>  =  i  -  ■  °-7475 

which  is  identical  to  the  burst  rate  obtained  directly  from  the  data. 

For  the  purpose  of  comparison  to  the  data  the  expression  for  the  anti- 
cumulative  burst  distribution  Pb(m)  is  obtained 

00 

Pb(m)  “  E  pb(k)  “  0* 2542(0, 7003)°” 2  -  0.0077(-0,3026)m“2  ,  m  a  2 
k*m 

Since  both  the  coefficient  and  the  root  of  the  second  term  are  small 
compared  to  the  first  term,  its  effect  is  negligible  for  m  &  5,  sc  that 
an  approximate  expression  for  Pb(m)  is  given  by 

Pb(m)  »  0. 2542(0. 7003)m" 2 

The  approximate  expression  for  the  burst  distribution  given  from  the 
model  is  shown  in  Fig.  1  together  with  the  distribution  obtained  directly 
from  the  data.  It  is  seen  that  it  is  in  excellent  agreement  up  to  m  ■  8. 
For  higher  values  of  m  the  approximation  is  still  relatively  very  good  in 
view  of  the  fact  that  the  probabilities  involved  are  very  small.  The 
exact  expression  of  (21)  is  expected  to  yield  a  better  approximation  to 
the  data  as  it  has  an  additional  exponent  which  would  help  improve  the 
fit.  Definite  statements  concerning  the  validity  of  the  model  may  be 
made  only  after  tho  comparison  for  several  values  of  K  has  been  performed. 
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SECTION  3 


CODE  EVALUATION 


3.1.  PRODUCT  CODES 

Product  codes  [1]  are  attractive  in  many  types  of  data  communica¬ 
tion  systems.  They  are  capable  of  correcting  simultaneously  random  errors 
and  burst  errors.  Although  their  implementation  is  slightly  more  complicated 
than  that  of  interleaved  codes,  product  codes  are  considerably  more  powerful 
than  interleaved  codes. 

The  decoding  of  a  product  code,  first  proposed  by  Elias,  can  be 
reduced  to  the  decoding  of  its  subcodes  of  shorter  code  length.  In  this 
type  of  decoding,  rows  are  decoded  first,  then  columns  and  if  necessary 
code  words  of  higher  dimensions  are  decoded.  Naturally,  majority- logic 
decoding  can  be  applied  to  the  decoding  of  the  subcodes.  Furthermore, 
it  has  been  shown  recently  that  the  information  about  the  decoding  of  row 
codes  can  be  carried  over  to  the  decoding  of  the  column  codes,  thus  a 
product  code  is  capable  of  correcting  all  the  error  patterns  guaranteed 
by  the  minimum  distance  in  addition  to  many  other  correctable  errors  [2], 

The  performance  of  a  product  code  on  a  real  channel  depends  on 
the  decoding  scheme  used.  We  will  consider  only  the  two-dimensional 
product  codes.  Furthermore,  a  cascade  decoding  [3]  scheme  will  be  used. 

This  decoding  scheme  can  be  simply  implemented.  In  addition,  the  probability 
of  error  can  be  calculated  from  the  statistics  of  the  channel  data. 

A  two-dimensional  (nin2,kjk2)  product  code  is  the  direct  product 
of  an  (n^,k^)  row  code  and  an  (n2,k2)  column  code.  Let  and  be  the 
error  correcting  capabilities  of  the  row  code  and  column  code,  respec¬ 
tively.  A  code  word  of  the  product  code  can  be  arranged  in  a  two-dimen¬ 
sional  array  so  that  every  row  forms  a  code  word  of  the  (n^,kp  code  and 
every  column  forms  a  code  word  of  the  (n2>k2)  code.  The  array  is  depicted 
as  follows: 

< - nl - > 

f 

n2 

I 

4/ 


Let  us  assume  that  a  code  word  is  transmitted  column  by  column. 
At  the  receiver,  rows  are  decoded  according  to  the  decoding  scheme  for 
(n^,k^)  code.  Columns  are  decoded  according  to  the  decoding  scheme  for 

(n2,k2)  code  after  all  rows  have  been  decoded. 


?-■ 

& 

r 

I 


Let  P  (m,n)  be  the  probability  that  m  errors  occurred  in  n  bits, 
with  each  bit  l  positions  apart  from  the  next  bit.  P  .(m,n)  can  be  obtained 
directly  from  the  channel  data. 

The  probability  of  m  errors  in  a  row  is  by  our  definition  equal 
to  P  (m,n..).  Since  the  row  code  is  capable  of  correcting  t.  errors.  The 

^2  i  A 

probability  of  decoding  error  in  a  row  is 

S  =  Pr{more  than  t^  errors  in  a  row} 

-  Pn2(>  h’V 

i=tj+l 

Here  the  bounded-distance  decoding  of  the  row  code  is  assumed.  The 
probability  of  correctly  decoding  is 


1  -  S  ■=  Pr{at  most  t^  errors  in  a  row} 


n2  1  1 


-  Z  V  (i,n.)  (2) 

i-0  n2  1 

Let  us  assume  that  the  probability  of  decoding  error  in  a  row 
is  made  independent  of  the  other  row.  Thus  S  is,  a  constant,  independent 
of  row  code  words.  The  probability  of  j  errors  in  a  column  is  obtained 
from  the  binomial  distribution 


n2  i  Vj 

P(j,n2)  "  (  /)sJ(1"S)  • 

The  probability  of  error  for  the  product  code  is  then 


P  5  E  P(j,n  ) 
e  J-t2+l  2 


2  n2  \  Vj 

E  (  7)  SJ(1-S)  Z 

j"t2+l  J 

t2  n  j  n2-^ 

1  -  E  (")SJ(1-S) 

j-0  3 
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In  the  next  period,  several  product  codes  will  be  evaluated 
for  their  performance  according  to  Equation  (4) . 
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